Skip to content

Remove validate scorer smoketest#708

Merged
alb-rl merged 1 commit into
mainfrom
alb/remove-validate-scorer-test
Feb 4, 2026
Merged

Remove validate scorer smoketest#708
alb-rl merged 1 commit into
mainfrom
alb/remove-validate-scorer-test

Conversation

@alb-rl

@alb-rl alb-rl commented Feb 4, 2026

Copy link
Copy Markdown
Contributor

User description

Remove unused smoketest


CodeAnt-AI Description

Remove scorer validation step from object-oriented smoketest

What Changed

  • Removed the standalone "validate scorer" smoketest that called scorer.validate and asserted a numeric scoring_result
  • Remaining object-oriented scorer smoketests (update, get by ID, getInfo) remain unchanged

Impact

✅ Shorter smoketest runtime
✅ Fewer external validation calls during tests
✅ Fewer intermittent smoketest failures

💡 Usage Guide

Checking Your Pull Request

Every time you make a pull request, our system automatically looks through it. We check for security issues, mistakes in how you're setting up your infrastructure, and common code problems. We do this to make sure your changes are solid and won't cause any trouble later.

Talking to CodeAnt AI

Got a question or need a hand with something in your pull request? You can easily get in touch with CodeAnt AI right here. Just type the following in a comment on your pull request, and replace "Your question here" with whatever you want to ask:

@codeant-ai ask: Your question here

This lets you have a chat with CodeAnt AI about your pull request, making it easier to understand and improve your code.

Example

@codeant-ai ask: Can you suggest a safer alternative to storing this secret?

Preserve Org Learnings with CodeAnt

You can record team preferences so CodeAnt AI applies them in future reviews. Reply directly to the specific CodeAnt AI suggestion (in the same thread) and replace "Your feedback here" with your input:

@codeant-ai: Your feedback here

This helps CodeAnt AI learn and adapt to your team's coding style and standards.

Example

@codeant-ai: Do not flag unused imports.

Retrigger review

Ask CodeAnt AI to review the PR again, by typing:

@codeant-ai: review

Check Your Repository Health

To analyze the health of your code repository, visit our dashboard at https://app.codeant.ai. This tool helps you identify potential issues and areas for improvement in your codebase, ensuring your repository maintains high standards of code health.

@alb-rl
alb-rl requested a review from james-rl February 4, 2026 18:11
@codeant-ai

codeant-ai Bot commented Feb 4, 2026

Copy link
Copy Markdown
Contributor

CodeAnt AI is reviewing your PR.


Thanks for using CodeAnt! 🎉

We're free for open-source projects. if you're enjoying it, help us grow by sharing.

Share on X ·
Reddit ·
LinkedIn

@codeant-ai

codeant-ai Bot commented Feb 4, 2026

Copy link
Copy Markdown
Contributor

CodeAnt AI finished reviewing your PR.

@alb-rl
alb-rl force-pushed the alb/remove-validate-scorer-test branch from fc00e7c to d3f52da Compare February 4, 2026 18:16
@github-actions

github-actions Bot commented Feb 4, 2026

Copy link
Copy Markdown

⚠️ Object Smoke Tests & Coverage Report

Test Results

✅ All smoke tests passed

Coverage Results

Metric Coverage Required Status
Functions 97.48% 100%
Lines 86.49% - ℹ️
Branches 65.75% - ℹ️
Statements 85.19% - ℹ️

Coverage Requirement: 100% function coverage (all public methods must be called in smoke tests)

⚠️ Some object methods are not covered in smoke tests. Please add tests that call all public methods.

View detailed coverage report
File Functions Lines Branches
src/sdk.ts ❌ 96.15% 81.41% 70.83%
src/sdk/agent.ts ✅ 100% 100% 100%
src/sdk/blueprint.ts ✅ 100% 100% 80%
src/sdk/devbox.ts ✅ 100% 91.81% 96.96%
src/sdk/execution-result.ts ✅ 100% 92.68% 70.83%
src/sdk/execution.ts ✅ 100% 94.11% 83.33%
src/sdk/gateway-config.ts ✅ 100% 100% 100%
src/sdk/network-policy.ts ✅ 100% 100% 100%
src/sdk/scenario-run.ts ❌ 92.85% 75% 50%
src/sdk/scenario.ts ❌ 85.71% 91.66% 100%
src/sdk/scorer.ts ❌ 87.5% 93.33% 100%
src/sdk/snapshot.ts ✅ 100% 100% 100%
src/sdk/storage-object.ts ✅ 100% 80% 48.93%

📋 View workflow run

@alb-rl
alb-rl merged commit 9d5abdc into main Feb 4, 2026
9 checks passed
@alb-rl
alb-rl deleted the alb/remove-validate-scorer-test branch February 4, 2026 18:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants